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Abstract 

We study properties of quantum strategies, which are complete specifications of a given 
party's actions in any multiple-round interaction involving the exchange of quantum informa- 
tion with one or more other parties. In particular, we focus on a representation of quantum 
strategies that generalizes the Choi-Jamiolkowski representation of quantum operations. This 
new representation associates with each strategy a positive semidefinite operator acting only 
on the tensor product of its input and output spaces. Various facts about such representations 
are established, and two applications are discussed: the first is a new and conceptually simple 
proof of Kitaev's lower bound for strong coin-flipping, and the second is a proof of the exact 
characterization QRG = EXP of the class of problems having quantum refereed games. 

1 Introduction 

The theory of games provides a general structure within which both cooperation and competition 
among independent entities may be modeled, and provides powerful tools for analyzing these 
models. Applications of this theory have fundamental importance in many areas of science. 

This paper considers games in which the players may exchange and process quantum informa- 
tion. We focus on competitive games, and within this context the types of games we consider are 
very general. For instance, they allow multiple rounds of interaction among the players involved, 
and place no restrictions on players' strategies beyond those imposed by the theory of quantum 
information. 

While classical games can be viewed as a special case of quantum games, it is important to 
stress that there are fundamental differences between general quantum games and classical games. 
For example, the two most standard representations of classical games, namely the normal form 
and extensive form representations, are not directly applicable to general quantum games. This is 
due to the nature of quantum information, which admits a continuum of pure (meaning extremal) 
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strategies, imposes bounds on players' knowledge due to the uncertainty principle, and precludes 
the representation of general computational processes as trees. In light of such issues, it is neces- 
sary to give special consideration to the incorporation of quantum information into the theory of 
games. 

A general theory of quantum games has the potential to be useful in many situations that arise 
in quantum cryptography, computational complexity, communication complexity, and distributed 
computation. This potential is the primary motivation for the work presented in this paper, which 
we view as a first step in the development of a general theory of quantum games. The following 
facts are among those proved in this paper: 

• Every multiple round quantum strategy can be faithfully represented by a single positive 
semidefinite operator acting only on the tensor product of the input and output spaces of the 
given player. This representation is a generalization of the Choi-Jamiolkowski representation 
of super-operators. The set of all operators that arise in this way is precisely characterized by 
the set of positive semidefinite operators that satisfy a simple collection of linear constraints. 

• If a multiple round quantum strategy calls for one or more measurements then its represen- 
tation consists of one operator for each of the possible measurement outcomes. The proba- 
bility of any given pair of measurement outcomes for two interacting strategies is given by 
the inner product of their associated operators. 

• The maximum probability with which a given strategy can be forced to output a particular 
result is the minimum value of p for which the positive semidefinite operator corresponding 
to the given measurement result is bounded above (with respect to the Lowner partial order) 
by the representation of a valid strategy multiplied by p. 

We give the following applications of these facts: 

• A new and conceptually simple proof of Kitaev's bound for strong coin-flipping, which states 
that every quantum strong coin-flipping protocol allows a bias of at least 1 / \[2 — 1/2. 

• The exact characterization QRG = EXP of the class of problems having quantum refereed 
games (i.e., quantum interactive proof systems with two competing provers). This estab- 
lishes that quantum and classical refereed games are equivalent in terms of expressive power: 
QRG = RG. 

Relation to previous work 

It is appropriate for us to comment on the relationship between the present paper and a fairly large 
collection of papers written on a topic that has been called quantum game theory. Meyer's PQ 
Penny Flip game ETll is a well-known example of a game in the category these papers consider. 
The work of Eisert, et al. flU is also commonly cited in this area. Some controversy exists over the 
interpretations drawn in some quantum these papers — see, for instance, Refs. ll5l[T0l. 

A key difference between our work and previous work on quantum game theory is that our 
focus is on multiple-round interactions. Understanding the actions available to players that have 
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quantum memory is therefore critical to our work, and to our knowledge has not been previously 
considered in the context of quantum game theory. 

A second major difference is that, in most of the previous quantum game theory papers we are 
aware of, the focus is on rather specific examples of classical games and on identifying differences 
that arise when so-called quantum variants of these games are considered. As a possible conse- 
quence, it may arguably be said that none of the results proved in these papers has had sufficient 
generality to be applicable to any other studies in quantum information. In contrast, our interest 
is not on specific examples of games, but rather on the development of a general theory that holds 
for all games. It remains to be seen to what extent our work will be applied, but the applications 
that we provide suggest that it may have interesting uses in other areas of quantum information 
and computation. 

A different context in which games arise in quantum information theory is that of nonlocal 
games (H, which include pseudo-telepathy games [6] as a special case. These are cooperative 
games of incomplete information that model situations that arise in the study of multiple-prover 
interactive proof systems, and provide a framework for studying Bell Inequalities and the notion of 
nonlocality that arises in quantum physics. While such games can be described within the general 
setting we consider, we have not yet found an application of the methods of the present paper to 
this type of game. Possibly there is some potential for further development of our work to shed 
light on some of the difficult questions in this area. 

2 Preliminaries 

This section gives a brief overview of various quantum information-theoretic notions that will 
be needed for the remainder of the paper. We assume the reader has familiarity with quantum 
information theory, and intend only that this overview will serve to establish our notation and 
highlight the main concepts that we will need. Readers not familiar with quantum information are 
referred to the books of Nielsen and Chuang ll3~0ll and Kitaev, Shen and Vyalyi ll23~1 . 

When we speak of the vector space associated with a given quantum system, we are referring 
to some complex Euclidean space (by which we mean a finite-dimensional inner product space 
over the complex numbers). Such spaces will be denoted by capital script letters such as X, y, and 
Z. We always assume that an orthonormal standard basis of any such space has been chosen, and 
with respect to this basis elements of these spaces are associated with column vectors, and linear 
mappings from one space to another are associated with matrices in the usual way. We will often 
be concerned with finite sequences Xi, X 2 , . . . , X n of complex Euclidean spaces. We then define 

= Xi® ■ ■ ■ ® Xj 

for nonnegative integers i, j < n, and define Xi j = C for i > j. 

It is convenient to define various sets of linear mappings between given complex Euclidean 
spaces X and y as follows. Let L(X, y) denote the space of all linear mappings (or operators) 
from X to y, and write L(X) as shorthand for L(X, X). We write H (X) to denote the set of 
Hermitian operators acting on X, Pos (X) to denote the set of all positive semidefinite operators 
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acting on X, and D(X) to denote the set of all density operators on X (meaning positive semidefi- 
nite operators having trace equal to 1.) An operator A E L(X, y) is a linear isometry if A* A = I X - 
The existence of a linear isometry in L(X, y) of course requires that dim(Af) < dim(^), and if 
dim(A') = dim(^) then any linear isometry A E L(X, y) is unitary. We let \J(X, y) denote the 
set of all linear isometries from X to y. The operator Ix E L(Af) denotes the identity operator 
on X. Transposition of operators is always taken with respect to standard bases. 
The Hilbert-Schmidt inner product on L(X) is defined by 

(A,B) = Tr(A*B) 

for all A, B E L(X). 

For given operators A, B E H (X), the notation A < B means that B — A E Pos (X). This 
relation is sometimes called the Lowner partial order on H (X). 

When we refer to measurements, we mean POVM-type measurements. Formally, a measure- 
ment on a complex Euclidean space X is described by a collection of positive semidefinite opera- 
tors 

{P a ■ a E £} C Pos (X) 

satisfying the constraint 

Here £ is a finite, non-empty set of measurement outcomes. If a state represented by the density 
operator p is measured with respect to such a measurement, each outcome a E £ results with 
probability (P a , p) = Tr (P a p). 

A super-operator is a linear mapping of the form 

$:L(X)^L(y), 

where X and 3^ are complex Euclidean spaces. A super-operator of this form is said to be positive 
if $(X) E Pos (y) for every choice of X E Pos (X), and is completely positive if & (g> 1-l{z) 
is positive for every choice of a complex Euclidean space Z. The super-operator $ is said to be 
admissible if it is completely positive and preserves trace: Tr($(X)) = Tr(X) for all X E L(X). 
Admissible super-operators represent discrete-time changes in quantum systems that can, in an 
idealized sense, be physically realized. 

The Choi-Jamiolkowski representation [|20i |71l of super-operators is as follows. Suppose that 
$ : L(X) — > L(y) be a given super-operator and let {|1) , . . . , \N)} be the standard basis of X. 
Then the Choi-Jamiolkowski representation of $ is the operator 

j($)= mi){j\)®\i){j\eL(y®X). 

It holds that $ is completely positive if and only if J($) is positive semidefinite, and that $ is 
trace-preserving if and only if Try( J($)) = I x . 

For two complex Euclidean spaces X and y, we define a linear mapping 

vec : L{X,y)^y®X 
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by extending by linearity the action |z) (j\ i— > \i) \ j) on standard basis states. We make extensive 
use of this mapping in some of our proofs, as it is very convenient in a variety of situations. 
Let us now state some identities involving the vec mapping, each of which can be verified by a 
straightforward calculation. 

Proposition 1. The following hold: 

1. For any choice of A, B, and X for which the product AXB T makes sense we have 

(A ® B) vec(X) = vec(AXB T ). 

2. For any choice of A, B G L(X, y) we have 

Tr x (vec(A)vec(B)*) = AB* , 
Ti y {vec{A)vec{B)*) = (B*A) T . 

3. For any choice of A, B G L(A') we have 

vec(I x )*(A ® B) vec(I x ) = Tt(AB t ). 

4. Let A G L{X,y®Z) and suppose $ : L(X) -> L{y) is given by ^{X) = Tt z {AXA*) for all 
X G L(X). Then 

J($) = Ti z (vec(A)vec(A)*). 

For any non-empty set C C H (X) of Hermitian operators, the polar of C is defined as 

C° = {A G H (X) : (B, A) < 1 for all B e C} , 

and the support and gauge functions of C are defined as follows: 

s(X | C) = sup{(X,F) : Y G C}, 
^(X | C) = inf{A > : X G AC}. 

These functions are partial functions in general, but it is typical to view them as total functions 
from H (X) to R U {oo} in the natural way. For any set C of positive semidefinite operators, we 
denote 

[C = {X : < X < Y for some Y G C}. 

Proposition 2. Let X be a complex Euclidean space and let C and T> be non-empty subsets of 
H (X). Then the following facts hold: 

1. IfC C V then V° C C°. 

2. If-X G Cfor each X G Pos (X) then C° C Pos (A"). 

3. If C is closed, convex, and contains the origin, then the same is true of C°. In this case we 
have C°° = C, 

s{- | C) = g{- | C°), and s{- | C°) = g{- \ C). 

The first two items in the above proposition are elementary, and a proof of the third may be found 
in Rockafellar EQ. 
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Figure 1 : An n-turn strategy. 

3 Quantum Strategies 

In this section we define the notions of a quantum strategy and the Choi- JamMkow ski representa- 
tion of quantum strategy. The remainder of the paper is concerned with the study of these objects 
and their interactions. 

Definition of quantum strategies 

We begin with our definition for quantum strategies, which we will simply call strategies given 
that the focus of the paper is on the quantum setting. 

Definition 3. Let n > 1 and let Xi, . . . , X n and y 1 , . . . ,y n be complex Euclidean spaces. An n- 
turn non-measuring strategy having input spaces X x ,...,X n and output spaces 3^i, • • • , 34 consists 
of: 

1. complex Euclidean spaces Zi, . . . , Z n , which will be called memory spaces, and 

2. an n-tuple of admissible mappings (<3>i, . . . , $„) having the form 

$i : L(#i) -> h(yi ® Zi) 

$ fc : L(X k <g> Z fc _i) -> LQ4 ® -Zfc) (2 < fc < n). 

An n-turn measuring strategy consists of items 1 and 2 above, as well as: 

3. a measurement {P a : a G X} on the last memory space Z n . 

We will use the term n-turn strategy to refer to either a measuring or non-measuring n-turn strategy. 
Figured] illustrates an n-turn non-measuring strategy. 

Although there is no restriction on the dimension of the memory spaces in a quantum strategy, 
it is established in the proof of Theorem [6] that every measuring strategy is equivalent to one in 
which dim(Z fc ) < dim(X 1 _ j e ® 3^i.../t) for each k — 1, . . . , n. 

We also note that our definition of strategies allows the possibility that any of the input or 
output spaces is equal to C, which corresponds to an empty message. One can therefore view 
simple actions such as the preparation of a quantum state or performing a measurement without 
producing a quantum output as special cases of strategies. 

When we say that an n-turn strategy is described by linear isometries At, ... , A n , it is meant 
that the admissible super-operators $!,...,<&„ defining the strategy are given by $ fe (X) = A k XA* k 
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for 1 < k < n. Notice that, when it is convenient, there is no loss of generality in restricting ones 
attention to strategies described by linear isometries in this way. This is because every admissible 
super-operator can be expressed as a mapping X i— > AX A* for some linear isometry A, followed 
by the partial trace over some "garbage" space that represents a tensor factor of the space to which 
A maps. By including the necessary "garbage" spaces as tensor factors of the memory spaces, and 
therefore not tracing them out, there can be no change in the action of the strategy on the input and 
output spaces. Along similar lines, there is no loss of generality in assuming that a given measuring 
strategy's measurement is projective. 

Interactions among strategies 

A given n-turn strategy expects to interact with something that provides the inputs corresponding 
to X 1 , . . . , X n and accepts the strategy's outputs corresponding to y 1: . . . , y n . Let us define an 
n-turn co-strategy to be the sort of object that a strategy interfaces with in the most natural way. 

Definition 4. Let n > 1 and let X±, . . . , X n and 3^1, • • • , 34 be complex Euclidean spaces. The 
spaces Xi, . . . , X n are viewed as the input spaces of some n-turn strategy while y±, . . . , y n are 
to be viewed as its output spaces. An n-turn non-measuring co-strategy to these spaces consists 
of: 

1. complex Euclidean memory spaces Wo, • • • , W n , 

2. a density operator p E D(Xi Wo), and 

3. an n-tuple of admissible mappings (\T/i, . . . , having the form 

q k : L(34 ® W fc -i) -> L{X k+1 ®W k ) (1 < k < n - 1) 

^:L(;y n ®Wn-i)^L(Wn). 

An n-turn measuring co-strategy consists of items 1, 2 and 3 above, as well as: 

4. a measurement {Qb : b E T} on the last memory space W„. 

As for strategies, we use the term n-turn co-strategy to refer to either a measuring or non-measuring 
n-turn co- strategy. 

Figure [2] represents the interaction between an n-turn strategy and co-strategy. 

We have arbitrarily defined strategies and co-strategies in such a way that the co-strategy sends 
the first message. This accounts for the inevitable asymmetry in the definitions. While it is possible 
to view any n-turn co-strategy as being an (n + l)-turn strategy having input spaces C, • • • , 34 
and output spaces Xi, . . . , X n , C, it will be convenient for our purposes to view strategies and 
co-strategies as being distinct types of objects. 

Similar to strategies, there will be no loss of generality in assuming that the initial state p 
of a co-strategy is pure, that each of the admissible super-operators . . . , \l/ n takes the form 
tyj(X) = BjXB* for some linear isometry Bj, and, in the case of measuring co-strategies, that 
the measurement {Qb : frGTjisa projective measurement. 
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Figure 2: An interaction between an n-turn strategy and co- strategy. 



An n-turn strategy and co-strategy are compatible if they agree on the spaces X x , . . . , X n and 
3^i, . . . , y n - By the output of a compatible strategy and co-strategy, assuming at least one of them 
is measuring, we mean the result of the measurement or measurements performed after the inter- 
action between the strategies takes place. In particular, if both the strategy and co-strategy make 
measurements, then each output (a, b) E £ x T results with probability 

(P a ® Qb, (h(z n ) ® *„) • • ■ ($1 ® h(w ))po) ■ 
A new way to represent strategies 

The definitions of strategies and co-strategies given above are natural from an operational point of 
view, in the sense that they clearly describe the actions of the players that they model. In some 
situations, however, representing a strategy (or co-strategy) in terms of a sequence of admissible 
super-operators is inconvenient. We now describe a different way to represent strategies that is 
based on the Choi-Jamiolkowski representation of super-operators. 

Let us first extend this representation to n-turn non-measuring strategies. To do this, we asso- 
ciate with the strategy described by . . . , $ n ) a single admissible super-operator 

S:L(^ 1 ... n )^L(A..n). 

This is the super-operator that takes a given input £ E D(Xi... n ) and feeds the portions of this state 
corresponding to the input spaces Xi,...,X n into the network pictured in Figure [Q one piece at 
a time. The memory space Z n is then traced out, leaving some element S(£) E D(3^i... n )- Such 
a map is depicted in Figure [3] for the case n — 3. The Choi-Jamiolkowski representation of the 
strategy described by . . . , $ n ) is then simply defined as the Choi-Jamiolkowski representation 
J(H) of the super-operator H we have just defined. 

An alternate expression for the Choi-Jamiolkowski representation of a strategy exists in the 
case that it is described by linear isometries (A 1 , . . . , A n ). Specifically, its representation is given 
by Tr 2n (vec(A) vec(A)*) where A E L(Xi_ n , 3^i... n <8> Z n ) is defined by the product 

A = ® An) (I yi ... n _ 2 <g> A n _ x <g> I Xn ) ■ ■ ■ (A x ® I* 2 ...J. (1) 
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Figure 3: The super-operator E associated with a 3-turn strategy. 



Next we consider measuring strategies. Assume that an n-turn measuring strategy is given, 
where the measurement is described by 

{P a '■ a E S} C Pos (Z n ) , 

for some finite, non-empty set £ of measurement outcomes. In this case we first associate with the 
strategy a collection of super-operators {E a : a E £}, each having the form 

E a : L{X UM ) - L(^... n ). 

The definition of each super-operator E a is precisely as in the non-measuring case, except that the 
partial trace over Z n is replaced by the mapping 

X -> T^„ ((P 8 ® Iy^ JX) . 

Notice that 

where 5 is the mapping defined as in the non-measuring case. Each super-operators E a is com- 
pletely positive but generally is not trace-preserving. The Choi-Jamiolkowski representation of the 
measuring strategy described by . . . , $ n ) and {P a : a E X} is defined as { J(E a ) : a E £}. 

In the situation where a measuring strategy is described by linear isometries A±, . . . , A n and a 
measurement {P a : a E S}, its Choi-Jamiolkowski representation is given by {Q a : a e S} for 

g a = Tr 2n (vec(S )vec(S a )*) 

where 

for ^4 as defined above ([T]). 

It is not difficult to prove that for given input spaces Xi,...,X n and output spaces 3^1, • • • , 34, 
a collection {Q a : a G S} of operators is the Choi-Jamiolkowski representation of some n-turn 
measuring strategy if and only if Q = Xlaes Q a ls me representation of an n-turn non-measuring 
strategy over the same spaces. 
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Finally, we define the Choi-Jamiolkowski representation of measuring and non-measuring co- 
strategies in precisely the same way as for strategies, except that for technical reasons the resulting 
operators are transposed with respect to the standard basis. (This essentially allows us to eliminate 
one transposition from almost every subsequent equation in this paper involving representations of 
co-strategies.) Specifically, a given n-turn co-strategy is viewed as an (n + l)-turn strategy by in- 
cluding an empty first and last message as discussed previously. This strategy's Choi-Jamiolkowski 
representation is defined as above. The operators comprising this strategy representation are then 
transposed with respect to the standard basis to obtain the Choi-Jamiolkowski representation of the 
co-strategy. 

As we work almost exclusively with the Choi-Jamiolkowski representation of strategies and co- 
strategies hereafter, we will typically use the term representation rather than Choi-Jamiolkowski 
representation for brevity. 

4 Properties of representations 

The applications of Choi-Jamiolkowski representations of strategies given in this paper rely upon 
three key properties of these representations, stated below as Theorems [5J[6l and[9l This section is 
devoted to establishing these properties. 

Interaction output probabilities 

The first property provides a simple formula for the probability of a given output of an interaction 
between a strategy and a co- strategy. 

Theorem 5. Let {Q a : a E £} be the representation of a strategy and let {Rb : b E T} be the 
representation of a compatible co-strategy. For each pair (a, b) E £ x V of measurement outcomes, 
we have that the output of an interaction between the given strategy and co-strategy is (a, b) with 
probability (Q a , Rb). 

Proof. Let us fix a strategy and co-strategy whose representations are {Q a : a E £} and 
{R a : a E T}, respectively. Without loss of generality, the strategy is described by linear isome- 
tries A 1 , . . . , A n and a projective measurement {Il a : a E £}, while the co-strategy is described 
by apure initial state u , linear isometries Bi, . . . , B n and a projective measurement {A b : b E T}. 
For each output pair (a, b) E £ x T, define v a ,b E Z n ® W n as follows: 

v a ,b = (n a ® A b )(I Zn ® B n )(A n ® I Wn _A ■ ■ ■ ® B 1 )(A 1 ® I W() )u . 

The probability of the outcome (a, b) is ||i; & || 2 for each pair (a, b). 

Now, making use of the vec mapping, we may express v a ^ in a different way: 

v a ,b = (vec {Iy 1 ... n ®x 1 ...S ® Iz n ®w n ) (x a <g> y b ), 

where 

x a = (lx 1 ... n ®y 1 ... n ®z n ® vec ( J ^i...n-i)*) (vec(Ai) ® • • • ® vec(A n _i) ® vec((n a ® 7^)^)), 
Vb = {lxi... n ®yi...n®w„ ® vec (^w ...„-i)*) (uo ® vec(Bi) ® • • • ® vec(5 n _i) ® vec(A fe S n )). 
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The probability of outcome (a, b) is therefore 

= ™c(lyi... n vxi...n)* [(^ Zn x a x* a ) 
= Tr (Tr Zn x a x* a ) (Tr Wn y b y* b ) T 



as required. 



(Qa, Rb) 



(Tr Wn y b yl)] vec(I yi ...„^ ...J 



□ 



Characterization of strategy representations 

Let us denote by 

£?i(<^l...n> 3^1...n) 

the set of all representations of n-turn strategies having input spaces X 1 , . . . , X n and output spaces 
3^1, . . . , y n . We may abbreviate this set as «S n or S whenever the spaces or number of turns is clear 
from the context. Similarly, we let 

co-S n (Xx,.. n , y%, ,. n ) 

denote the set of all representations of co-strategies for the same spaces. It will be convenient to 
define S (C, C) = co-S (C, C) = {1}. 

The second property of strategy representations that we prove provides a characterization of 
S n (Xi...n, yi...n) in terms of linear constraints on Pos (D^i... n <8> X\... n )- 

Theorem 6. Let n > 1, let Xi, . . . , X n and 3^i, • • • , 34 be complex Euclidean spaces, and let 
Q E Pos (^i...n ® X Um ). Then 

Q E S n (Xi . n , 3^l...n) 



if and only if 



for R E S n -i(Xi. yi. ..n-1 



Try n (Q) = R®I Xn 



Proof. First assume that Q E S n (Xi_ n ,yx_ n ), which implies that there exist memory spaces 
Zi, . . . , Z n and admissible super- operators $i, . . . , <3> n that comprise a strategy whose represen- 
tation is Q. Let H n : L(Afi.„ n ) — ► L(3^i... n ) be the super-operator associated with this strategy as 
described in Section [31 and let 



-n-1 



: L(* L ..„-i) -> L(y 1 ... n _ 1 ) 



be the super-operator associated with the (n — l)-turn strategy obtained by terminating the strategy 
described by . . . , $„) after n — 1 turns. We have 



Tr yn (J(S n )) = J(Try n 



J(S„_i oTV^J = J(S„_i)®/^ 
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and so Try n (Q) = R® I Xn for 

R — J\Z"n-l) G <Sn-l(Al...n-l> 3^1. ..n-l) 

as required. 

Now assume that Q E Pos (3^i...n <8> ^i... n ) satisfies Try n ((5) = R ® I Xn for some choice of 
i? G «S ri _i(Af 1 ... n _ 1 , 3^i. ..n-i)- O ur goal is to prove that Q G «S n (A4... n , ]Vi...n)- This will be proved 
by induction on n. In fact, it will be easier to prove a somewhat stronger statement, which is that 
the assumptions imply that there exists a strategy whose representation is Q that (i) is described by 
linear isometries A±, . . . , A n , and (ii) satisfies dim(Z n ) = rank(Q). 

If n — 1, there is nothing new to prove: it is well-known that if Q E Pos (3^i <S> Xi) satisfies 
Tiy^Q) = I Xl , then Q = J($i) for some admissible super- operator $ x : L(Xi) — > L(^i). Any 
such super-operator can be expressed as 

$ 1 (X) = Tr Zl A t XA{ 

for dim (,2^) = rank(Q) and some choice of a linear isometry A 1 E L(A\, <8> -2i). The 1-turn 
strategy we require is therefore the strategy described by A 1 . 

Now assume that n > 2. By the induction hypothesis, there exist spaces Z 1: . . . , Z n _i and 
linear isometries A 1: . . . , with 

AieU^Ji^i), 

A fe G U(^ fe <g> Z fe _!, 34 ® 2*) (2 < fc < n - 1), 

such that 

R = Tr Zn _ 1 (vec(A)vec(A)*) 
for A E L(A'i... n _i, 3 ; i...n-i <g) -Zn-i) defined as 

^ = (I yi ... n - 2 ® • • • (Ai (g) /^...^J. 

As required, we let Z n be a complex Euclidean space with dimension equal to the rank of Q, 
and let B E L(A\... n , 3^i...n ® 2 n ) be any operator satisfying 

Tr Zn (vec(B)vec(B)*) = Q. 

Such a choice of B must exist given that the dimension of Z n is large enough to admit a purification 
of Q. Note that 

Tr^„(vec(5)vec(5)*) = Tiy n (Q) = R®I Xn . 

Next, let V be a complex Euclidean space with dimension equal to that of X n , and let V E 
\J(X n , V) be an arbitrary unitary operator. We have 

Tr v (wec(V)wec{V)*) = I Xn , 

and therefore 

Tr^^v (vec(A <g> V) vec(A <g> V)*) = R <g> I Xn . 
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At this point we have identified two purifications of R <g> Ix n - We will use the isometric equiv- 
alence of purifications to define an isometry A n that will complete the proof. Specifically, because 
Z n -\ ® V has the minimal dimension required to admit a purification of R ® Ix n , it follows that 
there must exist a linear isometry U G U(Z n _i ® V, 34 <8> Z n ) such that 

(^...n-i ® U g> J vec(A <g> V) = vec(S). 
This equation may equivalently be written 

B = (/^ 1 ®i7)(A®y). 

We now define A n = U {Jz n - X ® V). This is a linear isometry from X n ® Z n _i to y n ® Z n that 
satisfies 

B = {Iy 1 ... n ^®A n ){A®I Xn ). 
This implies that the strategy described by Ai, . . . , A n has representation 

Tr^(vec(5)vec(£)*) = Q, 

and therefore completes the proof □ 

Theorem[6]is equivalent to the following statement: an operator Q G Pos (3^i...n ® <^i...n) is the 
representation of some n-turn strategy with input spaces Xx, . . . ,X n and output spaces 34, • • • , 34 
if and only if there exist operators Q%, . . . , Q n -i, where Q k G Pos (34..fc <8> <^i...fc), such that the 
following linear constraints are satisfied: 

Tt % ... n (Q) = Q fe -i®/^ fe ... n (2<*<n), 

Each operator Q k in of course uniquely determined by the representation Q, and represents the 
strategy obtained by terminating any strategy represented by Q after k turns. 

Theorem[6]also gives a characterization of n-turn co-strategies, as stated in the following corol- 
lary. 

Corollary 7. Let n > 1, let X x , . . . , X n and y 1 , . . . ,y n be complex Euclidean spaces, and let 
Q G Pos (34..n ® *Ln). Then 

Q G co-S n (A4.. n ,34... n ) 
z/and ozi/y z/Q = R <8> /y n /or i? G Pos (34...n-i ® <^i...n) satisfying 

Tr Xn (R) G co-<S n _ 1 (;t 1 ... n _ 1 ,34..n-i). 

The fact that «S n (A' 1 ... n , 34. .n) and co-«S n (A' 1 .., n , 34...n) are bounded and characterized by the 
positive semidefinite constraint together with finite collections of linear constraints yields the fol- 
lowing corollary. 

Corollary 8. Let n > 1, let X x , . . . , X„ and y x , . . . ,y n be complex Euclidean spaces. Then the 
sets S n (Xi n , 34. .n) and co-S n (X x 34. .n) o.re compact and convex. 
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Just as S n (Xi... n ,yi... n ) consists of all representations of non-measuring strategies, the set 
{S n {Xi w yi n ) consists of all elements of representations of measuring strategies. In other 
words, for any n-turn measuring strategy representation {Q a : a £ £}, it holds that Q a £ 
lS n (Xi... n , yi... n ) for each a £ S. Moreover, for each operator Q there exists an n-turn mea- 
suring strategy {Q a : a £ X} of which Q is an element if and only if Q £ [S n (X\... n , 3^i...n)- The 
set |co-5 n (A' 1 ... n , 3^i. ..n) has similar analogous properties. 

Maximum output probabilities 

The final property of strategy representations that we will prove concerns the maximum probability 
with which some interacting co-strategy can force a given measuring strategy to output a given 
outcome. 

Theorem 9. Let n > 1, let X 1 , . . . , X n and yi, ■ ■ ■ ,y n be complex Euclidean spaces, and let 
{Q a : a £ £} represent an n-turn measuring strategy with input spaces X 1 , . . . , X n and output 
spaces 3^i, ... , y n - Then for each a £ £, the maximum probability with which this strategy can be 
forced to output a, maximized over all choices of compatible co-strategies, is given by 

min-jjo £ [0, 1] : Q a < pR for some R £ <S n (<*i...n, ^...n)}- 
An analogous result holds when {Q a : a £ £} is a measuring co-strategy. 
The remainder of the present section is devoted to a proof of this theorem. 

Lemma 10. Let V and W be complex Euclidean spaces and letV C H (V) be any closed, convex 
set that contains the origin. Then for 

C = {X GH(V® W) : X < Y (g) J w for some Y £ V} 

we have 

C° = {Q £ Pos (V <g) W) : Trw(Q) £ V } . 

Proof. The assumption £ V implies that — R £ C for every R £ Pos (V <8> W), and therefore 
C° C Pos (V <g> W). Consider any choice of Q £ Pos (V <g) W), and note that 

(Tr w (Q),Y) = (Q,Y®I w ) 

for every choice ofF G H (V). 

If it is the case that Q £ C° then we have (Q, Y £g> I w ) < 1 for all Y £ V, and therefore 
Trw(Q) £ V°. On the other hand, if Tr w (Q) £ V° then (Q, Y <g> I w ) < 1 for all Y £ V. It 
follows from the fact that Q is positive semidefinite that (Q, X) < 1 for all X < Y <g> I w , and 
therefore Q £C°. □ 

Lemma 11. Let V be a complex Euclidean space, let A,Bc Pos (V) be non-empty closed and 
convex sets, and suppose 

(IA)° = {X £ H(V) : X < Q for some Q£ B} . 

Then 

{[BY = {Y £ H (V) : Y < R for some R £ A} . 
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Proof. Let 

C = {Y E H (V) : Y < R for some R E A} . 

As -P E C for every P E Pos (V), it follows that C° C Pos (V). Clearly |^CC, and therefore 
C° C Thus, 

C° C (M)°nPos(V) =1B. 

On the other hand, we have that every Q G | £> is contained in (j .A) , implying that (Q, R) < 1 
for all i? G A As Q > 0, this implies that (Q, X) < 1 for X < R. Consequently, Q E C°. Thus 
| B = C°, and so (J, B)° = C as required. □ 

Lemma 12. Lef n > 1 an J /e? X\ , . . . , X n and y\ , . . . , y n be complex Euclidean spaces. Then for 
all X G H (3^i. .. n <8> <^i...n) we ftave 

1. X E {lS n {X\... n , yi... n ))° if and only if X < Q for some choice of Q E co-S n (Xi___ n , 3A....n)- 

2. X E (lco-S n (Xi_ n , 3^i...n))° if and only if X < Q for some choice ofQ E S n (Xi_ n , 3^i...n)- 

Proof. The proof is by induction on n. As |<S = |co-S = [0, 1] and (|«S )° = (|co-«S )° = 
(— oo, 1], the lemma holds for the case n — 0. 

Now suppose that n > 1. The two items in the statement of the lemma are equivalent by 
Lemma [TT1 so it will suffice to prove the first. 

Define ^cH (^i...n-i ® Xi...n) as 

£ = { Y : Y < P ® I Xn for some P E iS^} . 

By Lemma [101 we have 

£° = {QE Pos (}>!...„_! ® *L. n ) : Tr* n (Q) G (l^) } . 

Also define JF c H (3^i...n <£> ^i...n) as 

^ = {Z : Z < Q <g> Jy n for some Q E £°} . 

Again applying Lemma [TO], we obtain 

r = {RE Pos (^i... n ® *i...n) : Tr^i?) G £} . 

Now, by Theorem[6]we have T° = iS n (X 1 ^ n , ^i...n)> and so J" = (|«S n (Af 1 ... n , ^...n)) - By 
the induction hypothesis we have 

£° = {QE Pos (y 1 ... n _ 1 ^X 1 ... n ) : Tr* n (Q) Gjco-5^}, 

and therefore 

T = {Z : Z < Q ® Jy n for Tr* n (Q) G Ico-S^J . 
By Corollary [7] we have that 

T = {Z : Z < R for some i? G |co-<S n } , 

which completes the proof. □ 
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Proof of Theorem® Letp a E [0, 1] denote the maximum probability with which {Q a : a E S} 
can be forced to output a in an interaction with some compatible co-strategy. It follows from 
Theorem [5] that p a = s(Q a \ co-S). Using Lemma [T2l along with the fact that Q a is positive 
semidefinite, we have 

s(Q a | co-S) = s(Q a | | co-S) = g(Q a | (|co-«S)°) = g(Q a \ IS), 

which completes the proof. □ 



5 Applications 

Kitaev's bound for strong coin-flipping 

Quantum coin-flipping protocols aim to solve the following problem: two parties, Alice and Bob, 
at separate locations, want to flip a coin but do not trust one another. A quantum coin-flipping 
protocol with bias e is an interaction between two (honest) strategies A and B, both having output 
sets {0, 1, abort}, that satisfies two properties: 

1. The interaction between the honest parties A and B produces the same outcome b E {0, 1} 
for both players, with probability 1/2 for each outcome. (Neither player outputs "abort" 
when both are honest.) 

2. If one of the parties does not follow the protocol but the other does, neither of the outcomes 
b E {0, 1} is output by the honest player with probability greater than 1/2 + e. 

Protocols that satisfy these conditions are generally referred to as strong coin-flipping protocols, 
because they require that a cheater cannot bias an honest player's outcome toward either result 
or 1. (In contrast, weak protocols assume that Alice desires outcome and Bob desires outcome 
1, and only require that cheaters cannot bias the outcome toward their desired outcome.) 

Kitaev (|22l proved that no strong quantum coin-flipping protocol can have bias smaller than 
1 / \pl — 1 /2, meaning that one cheating party can always force a given outcome on an honest party 
with probability at least l/y/2. Kitaev did not publish this proof, but it appears in Refs. Il2l [32l. 
Here we give a different proof based on the results of the previous section. 

Suppose {A , At, Aabort} is the representation of honest-Alice's strategy and {B , Bi, -B a bon} 
is the representation of honest-Bob's co-strategy in some coin-flipping protocol. These strategies 
may involve any fixed number of rounds of interaction. The first condition above implies 

± = (Ao,B ) = {A u B 1 ). 

Now, fix b E {0, 1}, and let p be the maximum probability that a cheating Bob can force 
honest-Alice to output b. Obviously we have p > 1/2. Theorem [9] implies that there must exist a 
strategy Q for Alice such that A b < pQ. If a cheating Alice plays this strategy Q, then honest-Bob 
outputs b with probability 

(Q,B b ) >-(A b ,B b ) = 
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Given that 

f 1 1 1 

max < p, — > > —= 

for all p > 0, we have that either honest-Alice or honest-Bob can be convinced to output b with 
probability at least 1 / \/2. 

This proof makes clear the limitations of strong coin-flipping protocols: the inability of Bob 
to force Alice to output b directly implies that Alice can herself bias the outcome toward b. Weak 
coin-flipping does not directly face this same limitation. Currently the best bound known on the 
bias of weak quantum coin-flipping protocols, due to Ambainis [Q]|, is that fi(log log(l/e)) rounds 
of communication are necessary to achieve a bias of e. The best weak quantum coin-flipping 
protocol currently known, which is due to Mochon ll28l . achieves bias approximately 0.192 (which 
surpasses the barrier 1 / y/2 — 1/2 ps 0.207 on strong quantum coin-flipping). 



Zero-sum quantum games 

Next, we define quantum refereed games. It will be noted that von Neumann's Min-Max Theorem 
for zero-sum quantum refereed games follows from the facts we have proved about representa- 
tions of strategies together with well-known generalizations of the classical Min-Max Theorem. 
Although it is completely expected that the Min-Max Theorem should hold for quantum games, it 
has not been previously noted in the general case with which we are concerned. (Lee and Johnson 
11261 proved this fact in the one-round case.) This discussion will also be helpful for the application 
to interactive proof systems with competing provers that follows. 

Let us first define specifically what is meant by a zero-sum quantum refereed game. Such a 
game is played between two players, Alice and Bob, and is arbitrated by a referee. The referee's 
output after interacting with Alice and Bob for some fixed number of rounds determines their 
pay-offs. 

Definition 13. An n-turn referee is an n-turn measuring co-strategy {R a : a £ £} whose input 
spaces Xi,...,X n and output spaces 34, • • • , 34 take the form 

Xk = A k <S> B k and 34 = C k <g> V k 

for complex Euclidean spaces A k , B k , C k and V k , for 1 < k < n. An n-turn quantum refereed 
game consists of an n-turn referee along with functions 

V A ,V B :E^R 

defined on the referee's set of measurement outcomes, representing Alice's payoff and Bob's pay- 
off for each output a £ S. Such a game is a zero-sum quantum refereed game if Va (a) +Vb (a) = 
for all a £ S. 

The referee's actions in a quantum refereed game are completely determined by its represen- 
tation {R a : a £ £}. During each turn, the referee simultaneously sends a message to Alice and 
a message Bob, and a response is expected from each player. The spaces A k and B k correspond 
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to the messages sent by the referee during turn number k, while C fc and V k correspond to their 
responses. After n turns, the referee produces an output a E S. 

A refereed quantum game does not in itself place any restrictions on the strategies available 
to Alice and Bob. For example, Alice and Bob might utilize a strategy that allows quantum com- 
munication, they might share entanglement but be forbidden from communicating, or might even 
be forbidden to share entanglement. Specific characteristics of a given game, such as its Nash 
equilibria, obviously depend on such restrictions in general. 

The focus of the remainder of the paper is on the comparatively simple setting of zero-sum 
quantum refereed games. In this case, we assume that Alice and Bob do not communicate or 
share entanglement before the interaction takes place. More precisely, we assume that Alice and 
Bob play independent strategies represented by A E S n (Ai... n ,Ci_.. n ) and B E S n {Bi___ n ,Vx_ n ), 
respectively. The combined actions of Alice and Bob are therefore together described by the 
operator A <g> B E S n {X x _ n: y x ... n ). 

It is a completely natural assumption that Alice and Bob play independent strategies in a zero- 
sum quantum refereed game, given that it cannot simultaneously be to both players' advantage to 
communicate directly with one another or to initially share an entangled state. This should not 
be confused with the possibility that entanglement among the players and referee might exist at 
various points in the game, or that the referee might choose to pass information from one player to 
the other. These possibilities are not disallowed when Alice and Bob's joint strategy is represented 
by A ® B. 

Now, assume that a zero- sum quantum refereed game is given, and that Alice and Bob play 
independent strategies A and B as just discussed. Let us write 

V(a) = V A (a) = -V B (a), 

and define 

R = Y J V{a)R a . 

Alice's expected pay-off is then given by 

J2 Via) (A ® B, R a ) = {A®B,R), 

while Bob's expected pay-off is — (A ® B, R). 

Now, (A ® B, R) is a real-valued bilinear function in A and B. Because the operators A and B 
are drawn from compact, convex sets S n (Ai... n , Ci...n) an d S n (Bi,,, n , T^i...n) respectively, we have 
that 

max min (A <g> B,R) = min max (A <g> B,R) . 

AeS n (Ai...„,Ci... n ) BES„(Bi... n ,T>x...n) BeS n (Bi. ..„,£>!...„) AeS n (Ai... n ,Ci... n ) 

This is the Min-Max Theorem for zero-sum quantum games. 

Note that the above expression does not immediately follow from von Neumann's original Min- 
Max Theorem, but follows from an early generalization due to J. Ville [|33l and several subsequent 
generalizations such as the well-known Min-Max Theorem of Ky Fan ifTTI . The real number 
represented by the two sides of this equation is called the value of the given game. 
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Quantum interactive proofs with competing provers 

Classical interactive proof systems with competing provers have been studied by several authors, 
including Feige, Shamir, and Tennenholts |fi~4~ll. Feige and Shamir lfi~3ll . Feigenbaum, Koller, and 
Shor lfi~5ll . and Feige and Kilian [12J. A quantum variant of this model is defined by allowing the 
verifier to exchange quantum information with the provers lfi~9~l[i~8ll . In both cases these interactive 
proof systems are generalizations of single prover interactive proof systems ll3ll4l [T6ll24l[34ll . 

Interactive proof systems with two competing provers are naturally modeled by zero-sum ref- 
ereed games. To highlight this connection we will refer to the verifier as the referee and the two 
provers as Alice and Bob. The referee is assumed to be computationally bounded while Alice and 
Bob are computationally unrestricted. Alice, Bob, and the referee receive a common input string 
x E {0, 1}*, and an interaction follows. After the interaction takes place, the referee decides that 
either Alice wins or Bob wins. 

A language or promise problem L = (L yes , L no ) is said to have a classical refereed game if 
there exists a referee, described by a polynomial-time randomized computation, such that: (i) for 
every input x E L yes , there is a strategy for Alice that wins with probability at least 3/4 against 
every strategy of Bob, and (ii) for every input x E L no , there is a strategy for Bob that wins with 
probability at least 3/4 against every strategy of Alice. 

The class of promise problems having classical refereed games is denoted RG. It is known that 
RG is equal to EXP. The work of Koller and Megiddo [|25l implies RG C EXP, while Feige and 
Kilian lfi~2ll proved the reverse containment. 

Let us note that zero-sum classical refereed games, and therefore the class RG, are unaffected 
by the assumption that Alice and Bob may play quantum strategies, assuming the referee remains 
classical. This assumes of course that the classical referee is modeled properly within the setting 
of quantum information, which requires that any quantum information that it touches immediately 
loses coherence. Equivalently, the referee effectively measures all messages sent to it by Alice 
and Bob with respect to the standard basis before any further processing takes place. As there 
also cannot be a mutual advantage to Alice and Bob to correlate their strategies using shared 
entanglement, there is no advantage to Alice or Bob to play a quantum strategy against a classical 
referee. This is not the case in the cooperative setting, because there Alice and Bob might use a 
shared entangled state to their advantage (S). 

Quantum interactive proof systems with competing provers are defined in a similar way to 
the classical case, except that the referee's actions are described by polynomial-time generated 
quantum circuits and the referee may exchange quantum information with Alice and Bob. The 
complexity class of all promise problems having quantum refereed games is denoted QRG. The 
containment EXP C QRG follows from EXP C RG. It was previously known that QRG C 
NEXP n co-NEXP HH, and we will improve this to QRG C EXP. This establishes the character- 
ization QRG = EXP, and implies that quantum and classical refereed games are equivalent with 
respect to their expressive power. 

In the refereed game associated with a competing prover quantum interactive proof system, 
the referee declares either Alice or Bob to be the winner. Specifically, the referee outputs one 
of two possible values {a, b}, with a meaning that Alice wins and b meaning that Bob wins. By 
setting V(a) = 1 and V(b) = 0, we obtain a quantum refereed game whose value is the maximum 
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probability with which Alice can win. We will show that this optimal winning probability for 
Alice can be efficiently approximated: it is the value of a semidefinite programming problem 
whose size is polynomial in the total dimension of the input and output spaces of the referee. It 
follows from the polynomial-time solvability of semidefinite programming problems lETl [P71 |29l 
that QRG C EXP. 

We will use similar notation to the previous subsection: for a fixed input x, the referee is 
represented by operators {R a , R b }, and assuming n is the number of turns for this referee we let the 
input and output spaces to Alice be denoted by A%, Ci, . . . , A n , C n while Bi, T)\, . . . , B n , V n denote 
the input and output spaces to Bob. The assumption that the referee is described by polynomial- 
time generated quantum circuits implies that the entries in the matrix representations of R a and R b 
with respect to the standard basis can be approximated to very high precision in exponential time. 

Now, given any strategy A E S n (Ai... n , Ci... n ) for Alice, let us define 

n a (A) = Tr Cl _ n9Al ... n ((A ® Iv 1 ... n ®B 1 ... n )R a ) , 

n b (A) = Tr Cl . M _ ((a ® iv^B^JRb) ■ 

The functions £l a and f2 b are linear and extend to uniquely defined super-operators. Under the 
assumption that Alice plays the strategy represented by A E S n (Ai... n ,Ci... n ) and Bob plays the 
strategy represented by B E S n (Bi,__ n , T>i_„ n ), we have that the referee outputs a with probability 
(A <S) B, R a ) = (B, Q a (A)) and outputs b with probability (A <g> B, R b ) = (B, Q b (A)). One may 
think of {Q a (A), Qb(A)} as being the co-strategy that results from "hard- wiring" Alice's strategy 
represented by A into the referee. 

Now, Alice's goal is to minimize the maximum probability with which Bob can win. For a 
given strategy A for Alice, the maximum probability with which Bob can win is 

max{(B,Q b {A)) : B e 5„(Bi... n , X>i...„)} 

which, by Theorem |9l is given by 

min{p > : Sl b (A) <pQ, Q E co-S n (Bi... n ,V 1 ... n )} . 

The following optimization problem therefore determines the maximum probability p for Bob to 
win, minimized over all strategies for Alice: 

Minimize: p 

Subject to: VL b (A) <pQ, 

A E S n (Ai...n,Ci... n ), 

Q E co-5 n (Bi.„ n ,Pi... n ). 
This optimization problem can be expressed in terms of linear and semidefinite constraints as 



20 



follows: 



Minimize: Tr(Pi) 
Subject to: Q b (A n ) < Q n , 

TrcMk) = M-i ®lA k (2<k<n), 
Tr Cl (A) = I Al , 

Q k = P k ®Iv k (l<k<n), 

Tr Bk {P k ) = Q k _! {2<k<n), 

A k e Pos (&...* ® Ai... k ) (l<k<n), 

Q k e Pos (Pi... fc <g> B x ... k ) (l<k<n), 

P fc ePos(Pi... fc _i(8)Bi... fc ) (l<A;<n). 
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